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1 

(c^^fiiL, fifE«-5^f"i®«rtic:i(^(?)!itia«r«-r!itja^ 

SdlEi^Sfl 5f Hfcii)ifeW^rogrlEA;tiiiitfe<^-en*'n(::*r 
ixfcWiSi- 5 ^ ^ ^ cDIiJ^ Jt-r 2) ffiS t- BSiS ^ -a-fc 

l-Blia-r2)ti:BiWIB«-^.^1- LfcifirfiltStT'foS Z.t^>^ 

ist-rsm*^ 1 ic:?E«g<oi®««i3aigB. 
[^*^3] sfiiamiRt)«^2.otefitt«ttffl#Sic 

■It. ft:*:S.o:§'h<7?iii^{iS<7?^, 

^%ic:Mi-2M^6aStirBti}«^tttili-'6 ^ tr#%^ 
•t-Sft*^ 2 {c:|E«ro®»«iaS?B. 

to 0 0 1 J 

[0 0 0 2] 

^U^«^cOHfe5r-g-^i-€.::i:-C, CCD (charge C 
oupled Device ) ^<OWi^^lk-^(7)@^n^^ -)- y^U 

^■t^m^imsM m^\ii. i^naBge 3-23259 

l^4ia) ^, |i3-ro»2rflE*S/£Si*;#l{tB-C«f0L 



(2) 

2 

(#BI¥^l-30 94 7 8#>2;«) iJfcS. 
[0003] Z<D&i^-^ i-S. yi' U^^t^B^^rf^^i"* 

fitWfi, mi 2 (a) (CTp-rffiRgr-Ha^ix-S, n^^? 

m-vnhti^m»o:>m^mt<r>Kmi.. mi 2 (b) « 
" [A] fti«raita" , " [B] mmmttm" 0*51- 

•0 [0004] ADKSg 1 1 -^(41)16 A, B(OBilgM;i:^K 

^ti. Hi 2 (b) ic " [c] mmm^" ti.xmi-m 

t'^yu-M.?t^V 1 2tc|aig$H€». " [C] M$f- 

mmm^ui a-c^, Ao»{t-^MsA^t,A#t*i:i 
[000 5] Lxmmmmn 1 e -C'i±. «i^A«3ts 

«g:i:<4S7W-Ap«*y 1 9icft*^$tb5. 

[0 0 0 6) rcoiii««!.3aa«»4, mscff^m^kf—fi: 

[0 0 0 7] mmLftAt>^^w><om^^mmx 
it*pW^n. p'l'-A/^y 2 2»ciEti^H5, ^g^te 
[ooo8]^w-x?, iHim7^/w;?®::eEiK2 

4lc:fei&Ni-S. :i<0)fem, 7U— 2 4Jj:fei&^$ 
[00 0 9] 

[^l^-05#P*UJ:pi-t-^>^l StliE UfcHftStafiEW 
I4, «»Lfciij«iS:-a, iii*rtJCi)Dai*fcl4fi^f+ 
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3 

[0 0 1 01 -t-rofc*!). \^>'JVL±^m.<r) 
CMD (Charge Modurated Device ) ^^4rfi6o7t«IS§ 

[0 0 1 1 1 t^^fcML. tj-'-is^iJffl-rsJ; ^ 

[0 0 1 21 ^Jx.«. =W(::r'■:^^-'^*;^7*^•«r-C« 
o;^*), ffilS^p' 9-C•^t]^LfciI^fi^^^7^/^A;^df^■:^- 
[0 0 1 31 ^rT-*^eqi4, 

-O^S/iS J; ^ lc:tijE-t-5IIi««!raiSB*tltti-5 r i: S: 
[0 0 14] 

^:roHIift{r^5M^J;iBiiiS-arfc«rB««i: UTtttiJ 

i-?>m 2 o{stB<f attains fflai$ixfcBfiiEit#iis:e*) 

[0 0 151 W±<OJ;9/£«^<OSifefe3aigfil4. A:^ 
^«rK^L, JErro#m^K»SSttBSrlE1t-t-S. -troit* 



4 

B»« (iRri^ilift. mU^m «r»fflU, -^*y!:« 
[00 161 

[0 0 171 :^mMJ&m\zi3\,^X. la^L./iVT'v'^'yi' 
•i-^xm'Oiht.ixftmmi-i-'-— Kt'-t 

[0 0 181 *iiJS}i?jii4. izm-rzt. fl^flH^^— kt' 

f^mizE-r -5 J; o r fflFBlgjm LMM^ roffi^fisro 

{4BBi^*ffiiE-r5iii^«iEgi5 3 0 mtimmmiEU 

3 o»c J: •3filrfiBa«75SMlE$*Lfciii«lcWL-C, StriEU 

®»#fi!<;JfB3 9 fCfllfig^ttS. 
[0 0 1 9l SfcBftlEiii^feMjEfiRS Ott, MflK-T-^W 

^«fi5 3 1 t?#fi«ia*5tftonfcw^7'-^'*-^6<){ciE 

7 u-i*^*y 3 2 ilS^^ixfc iocoiii^jc: 
mMU3 3 ir.^(75#tSS:^ffiSSrlE1t-r5!|fSt^ta:Bp< 

jtS^M^ffiB^IElt-tSm^fitfip' * y 3 6 t , 

SrffljEL-Ciii«^figgl5 3 9 l,cmt]-ti>mf^mS^U3 8 t 
(0 0 2 01 r(73J;5(-«fi&$n«:*IIJSJi?ffiroilI^4!i 

3 2(cfEtt$ti-5o rr-C% iIi^7'-:?S±«fB3 1 

[0 0 2 11 »:i;iA;biii«<0 9t,itS:^ss«^ix (rr 
niffli«Ati-5) . !|*®;Si89:!£SB3 3ic:A;^$ti-5. 

mm S:ia::£L. #®;^i^^7)54*8([^fS!rB>*y 3 



(4) 

5 

[002 2] H^iS-MMm^ 3 5 fJi. I^^M.Wl-&U 3 3 
B) . A;^$n.fcx>-rw'- urm-i-S/l^iaim-r 
10 0 2 31 '&<0*g*, MlS^MSffig-SJWfS^tte^ 

3 eictu^sns, ttiE/<7;<-^'^ttjSB3 tq lo 

y * y 3 6 (/5*J-JC;^ffi^S:S5^ai 2 tfctDM^^ Wffi 
669^ (¥ffgf»S:, lUeAft) «r»mi-So -tLTM 
W^^mSi5 3 8-ei4, Xtl^ntz^mM'^ii^h. -iS-^t:! 
l4H*»®««r«jELTiIifi^-&^eiJ3 9lcm;'3-rSo 

[0 0 2 4] rcoMife^^iiBs 9-ei±, filii^ufc^^'r'-^- 
J^*i:-r5Si«-65««I^<Oiii««IESB3 0-r-ffiBfc*^ 

[0 0 2 5] H 2 ;c(4, m^>^^M.mi-^U 3 3 com^S^r 

fi^m-tt^hi>, ^:i-C®«c;»-f'lgl54 1-C(4. 
iiilfe'*'-Cj83{::»t,tf5±^Jc-f€>fc«), W««r1S»ro 

i-s. r-f, ±m^t^^ic^WiLtim^m3 (a) 

[0 0 2 6] r<D^^tf'T-X>'7°U— hcof^Mt^'iS/h 30 
T < Ifch 

fii/^t LTSIfflL/j:v\ {5iJx.«, ms (b) (ctJCtS^ 
14 (2) S:(Oj;3''f«tT^t,o!|#m;§.^ffifi:B(-t4!|#m « 

(00 3 2] n 4 14, Mit^M.mm^ 3 5 <Dmi$.^wLm-t 
S0t?fos. -b— 5^31 y TS^SB 5 1 -e(4, 

ifi5 3 3i4>feglE;^WLfc#?S;affi«ISrSJilC, JtJjJ^Srfil 
9^-tSSg*£offifii::k:#$^^^i-.5, ffi^S3?|f|5 5 2 

T?j4, -^-^o^ y rta^ifB 5 1 x-m^^tiit-^-'^^ y 
TrtK)W«tcS-^^,^-c, !|tiS^^^SB3 3 7b^e>A:^$n 



5 

10 0 2 7] l»:iZ7-yy\^—h{iLmik^U4 2Xit. # 
— MSItfltBSrSt^eu, 
{fitBJ-S^V^TT-^yu- httmif|54 3t?X V-T'U- h 

hfi:B*^Si5 4 2r-f4, y^^yi— 

[00 28] C!!:BW(ci^^^7^>-7'U'- h^M<^il#Stfi^ 
{t:(4, <f£^^m'^iii>^<DX\ :L(DXoti:m 

^J4x>'7'u- h^^Mo&B* 1 Hitlfe-f e>-rw-cf4* 
<, ^iil**3#|c-f t,-t--i:t-Ct, igm«Uctl-W*Sr 

nm-ri>ztt^x'^i>o 

[0 0 2 9] !|*8i[*JftaSi54 4-e»4, f^V^ U— 

4 614, Tyy'U— Sii^iD^m^iltti^Xi, 
mt>fj:\,\ rroltrnfti: L-CI4, C9J;t»4 (1) ^iCyr^-T 

[0 0 3 0] 
[IS1] 

i 

a ii4iii^M, ai47'>-:^u— H^ffii^coiiiig 

So :ftfl£6<J^i^l4^lf?iV^;45, 2»:<0®^ffi^» 

[0 0 3 1] 

(2) 

-^'*»?>^l3taL, 1#«;l^l9:SgP3 3;i»P>A:^$ttfcv' 
[ 0 0 3 3 ] +ag|<iW3tSa5 5 3 -C-14, 7'>7'U~httaj 

[0034] r«7)i:#, -«rlc:m;fe«t««4, i BiSSfe 

(c^!tiUTtBBHi:srJti».5*s, mm&.T<Dm&xnit-^ 

J: 0m/SfiB«r9ti£Lrtav\ ^roffiMfitt UT 

14, iJctr) (3) S:ic,T^-rM^J<7>if6J*{tfii, (4) ^iz^ 
■f-tSStBBS, (5) iClc;^i-iEm*iStaBI«*r^ p r 

(0 0 3 51 
(«C3l 



2(ai - A ).(bi -B ) 
E = (5) 

5A..:.5a 



(5) 

7 8 
£ = 5:|at-bil (3) ^^m^f^^o 

1 [0 0 3 7] ^LT^iE^'?7>— t^'SLfflSPa 7X-\t.. ^ 

E » - A ).(bi - B ) (4) Br«ioffieBiff><^gt^-r5o (e) 

^ ^<7)cos 0 , sin 0 , s X, s y, M"C$>^o 

[0 0 3 81 
[»4l 

rx"i /'cos e - «in e't • x\ (Sy^^ 

rrT\ bi. Bli. u^BfT^i^— rrt-ei&ib-r lo 

^A-m^P^(omm{^t't(n^i^x-h^ . aA . ae J^t^ :i:it\ (x. y) (i4#8S[>^te@. (x, Y).ii*tiS^. 

^(o^nmtf^^. iB#«^ttK^^y 3 4. ^^jc^tiB^^y 3 6tci±. 

[0 0 3 6] tfris (2) ~ (4) ^^Vt'S-ir^m^. h W^<r>y'-^t^i^^^f\.x\^^^<ox\ ft/h-^Wtc/-?^ 

;&?-e#6o R, G, B«-fe(DffiM«I^^»U-C» [0 0 3 9] 

Ab" ~= M - sin e =~OtT^YX + y3( - St)/^,^ " Oy^) 
8^ s X ~ M • (x oo« 6 - y sin 0) 
Sy = Y - M • (X sin e + y oos 0) 



5? - i • f; xi • ri, voc = i • X; Xi • Yi 

N . Xi 



rr-C% Nii#tS^^o (8)^<t<9.M, COS0, s ^[0 0 4 0] 
in0(i (9) ^0«tC^^$H5o ^ [SC6] . 

Ae^ + A,2 „ (8) 



M a + A,2, COS G = ^ , Bin e « ^ 



191 



[0 0 4 1 1 :*:5t5 COS0, sin 0 {i. cos2 0 + ^(7) J: 9 tC cos 0 , sin 0 >^MjE LfclJ p t\ s 

sixfi e^KOmm^h^tz}^. nnm^^^^^^itt^ x, $ yll^IELfc cos©. sin0 J:«9tfK-r'5o 

JiV^<lr<S3£t?t^»-g'^ (9) «;coJ^m"C. M=l. 0 [00 4 2] 

(1 0) ^oj:5«Baff.(c/.coyi:4i^. (11) [«c7] 
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(6) 



e + sln^ e = (R * 1.0) 



008 0 -> • COS B, ain 6 ^ ^ • sin 6 
R R 



10 



UQ) 
(11) 



10 0 4 31 mmLtL (6) - (9) ^li. ffiicOK^ 
V>o 1#^#.Ofi|^fflrg^i ( /x, /y) (CrT\ / 



{/X, /Y) , T'-^X.^Hx COS0, sin0» sx, 
syfi^n-eK (12) . (13) *T^;tbn^o 
[0 0 4 4] 
> l»8] 



lin e = 0^ - yx) /^x^ + 



X - 



(12) 



Sy = T - y 

[0 0 4 5] ]ik±,mm i.tz J: 9 tc, :^mmmm\'i.. mm 
&xhht>^ci^miE ur*3 <-t ib^^z^m t * 6o 

[0 0 4 6] :*:^PJ{cJ:^^2(7)||i£ff^^{coV^ 
[0 0 4 7] ms (a) (1. »efe;^.IS^ffl 3 3 (;:>a.'t:W 

5 (b) (i. ffi«li>£a8 lO^^0iJ^^i-(gT*fc5o 
^«c^t?l^W8 3^C*5V^■C. 

[0 0 4 81 r<7D*?r:^J^$P8 4-Cfi. 

J^. Hie (a) . (b) <DXo{zA:hmmy^-^±iiC7ir 
w(7)«^Sl5 8 2(1. PClc{i-mc07^>f ;:^:7^U^T*t«t> 
ii^g|58 3 H. PC\zHm<o^i7:^x^7r:l.xiimt>fj: 

mi$,i^^^s 1 <Dm^(o-^t {.xnm Litres ^<-y 



(O 



(13) 

■^/i- n V — ^ ^o:*-^ 7^ ^ v^x-r 

[0 0 4 9] ^bic. m^^Tj^us 3xn. mm^<Dm 
it^^t^ic. m7r:^tifzm^i^mmui.ti:^i^x^ 

[00501 *:||*feJI?l|go«RKlc J: 0 . 
tc. h^^'£smxfj:\^^U^Xi'^»mAmmi:ii^^^t\^fJ: 

[0 0 5 1 ] ^fz. xm^m^^^j:t\ W}<is.^mm 
mmm^^^t^tzm^. m^tzu^(Dmm^ns-i^m\^^ 

[0 0 5 2] $b(c. mm^TT^ns 3xm^\^tzm^m 

io'\tmm^ii\cm±-r^^t7f)^'^mxh^o 
[0 0 5 3] ^it. ^4'r^-/^\y>i^it±^m<r>m^ 

mn-r^:ztx^ ^>^^j^\zm«Li:mviLxmn'r^m 
^{c\t-<xmm^\^±'r^ :l t t^-x^ 
[0 0 5 4] 1217(1. ^^m(r>ms(Dmmmmi:mirm 
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11 

[00 5 51 r * U 3 4 \Z.'S.^^fltimWiM. 

Stl^ (ffiJx.«. 1113 (b) ) 

fls:) ±l;i^^^nTvV5^. (6) - (1 0) ^T^tfff 

[0 0 5 6] ro^mi. ^^^tt/cx-^^r^-if- 
d^WKrU. iRFm^*g^g15 9 0 7!>^^l^^•t57"-^5^^^-r 
3 4 ir^iC^.^^y 3 6(757"— :$^^|s]^|C^^a5 8 2 

[0 0 5 7] ^IC|ll8<^#H8LT. ^mm\Z^^mA(D 

^i£ff^ffitcov^Tl^^.P.Bi-5o :i<7:»ll4(D^ffi?f^^*i. HI 
5 (omm^'^n 8 1 Sria 8 J: 5 X^ti 

[0 0 5 8] ms\z.7jk;^tt^mm^'^us i a. mmm 

^US3. «i«cffiB^^y 8 5. *tSg*iJ5Egl5 1 0 Id^'b 
[0 0 5 9] ^-f. ilJ^^ft:^IIl9 (a) cr)^e»l-i^i^ 

[0 0 6 0] ^m^titz^n^ita^mnmui o i 
[00 6 1] *fc. v^mm^u 1 0 1 T-(i. xti^f-^ 

3(i. 09 (b) OctptC. ^^SiJLyb«i«c(7)lI«f^-i$^ 

^mmz-^mm-^n i o i 4#is^.is:^M^<t 

9 ^ y 8 5 tcis^f 5o 

[0 0 6 2] MiSLTttt^T-ii. ^^mmm:::t\cn^ 



12 

ffiMp^^y 8 5(cfE®^nTi^5ffilS^{*t::LTt>St> 

13 9 (c) IC^UytJzptC. ®«jt:a^a5 8 

^75>bIIll»^c^«F^s;S^g^«a4^lc:^^•el^< J: 5 1- b-ct 

[0063] laio {;i^i-J: Ic. ®«tJg:^a 

[0 0 6 4] ati^ mQ\.itMmmi:ws\mmz.m\i^it 
^mp\-^ui 0 ix\t. xt}Ltzmm<Dmmy-v 

[0 0 6 5] ^^^it^j^asi 0 IXit. P<t)^tl 

\cm\^^xhmt>fj:\^\ mz.mi i^mmi^x. 
[0 0 6 6] *:^tgjf^S(i. 3m:i±<DmmmmMM!i 

[0 0 6 7] *3itgjK^«c*5v>r. m«Ly'-^w±t^s 

tL;&*<^7U— A^^y 3 2 a. 3 2 bfcA;^$ix5o r 

^^titzm^<omm^m^mmx^ s j; ^ (c^eo^s 

[0 0 6 8] tfrlE:7U— Ap?^y 3 2 a, 3 2h{Zt&»i 

^-^9im^3 7xnm&titiy<y;^-^-'it. ®« I 
[0 0 6 9] t(j|EffijE/>-^ ;^ -i?'^^^ 1 1 2 fi. ffilE 

[0 0 7 0] :ir-CMiE/'?^P<--^^1^gi51 1 2X<0^ 

-^wmMmii^^U3^x<omm±. mm\m^\ 

^y 3 2lc:iiie«r8K;^iiA/-CtT-:>-Ct«:b/<cv^ 
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[0 0 7 1] t.fz. i^mmmmx^s-tyi^-j^:^^') 3 2 
10 0 7 21 ^j.}L<oummm\z^^^xmm LittK 

--^t Lx<Dmmm<r>^u • ^id • »*^^t:^-s-5^^T 
[0 0 7 3] n 1 (Dmrnmrni^nft^-t^o w 

(2) fififs (1) mi^mm(Dmm^mmmi::^:^^^x. 
mjiEiHie • ^ib • mmmt{:im-^^^xmm^miE'r^^ 

10 0 7 4] :^^mitm 5 (^iitsfl^^tc^^f&i-^o cti 

(3) gtJlEli»05^iil«iatcov>T. :5^f«)-r^^*«<^ 
[0 0 7 5] ^2(^llfflf^^(c^/S;i-6o ^ 

(4) flijffi (1) (3) m^td.iSi(ommmm 
WJtffiSitffic^p^. m^(omm^xi(Lm^mmi.x\^^ 

[0 0 7 6] ms(ommwm\cnft^'i-:bo ^ 

(5) Hftie (3) ^(CfS«(7)iij^^SS^MlC:JdlNT. 
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[0 0 7 7] m4 0^i£f$fl|(c*|-jj;i-5o 

^m\mz.w^-t^z.ht-x^ . «]^#co«igtcj^;Dfc. 
(6) fflfis (5) 3g^c|E«<D^i^te^3ls^g|;l:}ov^r.. 

So 

[0 0 7 8] *«l^(l»4(^llli6?^|gJcm-t-'5o 

fi^)^.<Dmmzn\^xm^f^m^^WL^^^<ox\ 

So 

[0 0 7 9] 

[Hi] mi (D^mmmt LX(Dmm^mmm:(omfi^^i 

*>So 

[1^3] 1^3 (a) II. ®te?r«»<r>^»IU^4>f^«i«c 

113 (b) fi. #^ssc^.^col^Tlft0^i-sy^:i^>(DllTfo 

So 

$?So 

mms.(7)mj$.w^^irm. ms (b) a. mmm^n<r> 

liaei me (a) i±. iffi«ijc^*$nfcji^®«co 
-fiaj«r^-fia. He (b) ft. mi^L±^cm^^iMtmu 

in 7 ] » 3 (ommmmt LX(om^«mmm.<om^m 

113 91 09 (a) »4, «»OT^>S«l^«lc»»l$tiyhA 

;^iiii^^^i-I21. 119 (b) (±, ^Mizx^wm^n^ 
M^ro^t^(c-o^^TlftWi-■5fc^<)<^ll, 119 (c) 

[@io] m^j^ii-hmm{.ti!^mi:<i^mi^^'&f^i$t 
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* NOTICES * 

Japan Patent Office is not responsible for any damages caused by the use of this 
translation. 

1 . This docviment has been translated by computer. So the translation may not reflect the 

original precisely. 

2 ***♦ shows the word which can not be translated. 
3 . hi the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the image processing system which performs alignment processing between two 
or more images which photoed the almost same composition on different photography 
conditions A seek-area setting-out means to divide at least one image of the inputted image 
into two or more division fields, and to prepare the seek area of the focus showing the 
description of an image in said each division field. The 1st positional information extract 
means which the characteristic positional information of the photographic subject within said 
composition is related to the coordinate over each division field of said division image, and 
extracts it from the seek area of each of said focus based oh the characteristic quantity of 
said image, with the 2nd positional information extract means extracted as positional 
information which said input images other than said divided image were alike, respectively, 
and it received [ positional information ], searched [ positional information ] for the point 
corresponding to said characteristic positional information, and related the acquired point of 
corresponding to the coordinate over the image An amendment parameter appearance means 
to detect the amendment parameter based on the gap between each coordinate of said 
extracted characteristic positional information and the positional information of said point of 
corresponding, The image processing system characterized by providing an image 
amendment means to amend an image so that the photographic subject location of each 
image may be in agreement, based on the detected amendment parameter. 
[Claim 2] The positional information extracted by said 1st and 2nd positional information 
extract means is an image processing system according to claim 1 characterized by being the 
positional information which excepted the positional information relevant to the coordinate of 
the division field where the body which moves in the inside of said image was detected. 
[Claim 3] The positional information extracted by said 1 st and 2nd positional information 
extract means It is based on the value of the difference of the rate of a pixel that the high 
frequency component when carrying out orthogonal transformation was saturated 
comparatively, the average of a pixel value, and the greatest and minimum pixel value, and 
either of the contrast, to each division field in said image. The image processing system 
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according to claim 2 characterized by extracting the coordinate related positional information 
over a desired division field from said inputted image. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] When this invention relates to the equipment which compounds the 
image beyond the dynamic range and depth of field of an input device from two or more 
images which photoed the same photographic subject on different photography conditions, 
especially piles up each image, it relates to the image processing system which performs 
alignment amendment so that a photographic subject may be in agreement. 
[0002] 

[Description of the Prior Art] The image processing technique (for example, JP,63-232591,A) 
which creates the image which has the dynamic range of the range more than the dynamic 
range of the proper of image sensors, such as CCD (Charge Coupled Device), by 
compounding two or more images which generally photoed the same photographic subject by 
different exposure, and two or more images which photoed the same photographic subject in 
a different focal location are compounded, and there is an image processing technique 
(JP.1-309478.A) which creates the image which has depth of field deeper than the depth of 
field of input optical system. 

[0003] The technique which creates this extensive dynamic range image is realized with the 
configuration shown in drawing 12 (a). Image illustrated A and B are the images which 
changed and photoed exposure, respectively, and the relation between the amount of 
incident light which carries out incidence to an image sensor, and the signal value of the 
image obtained with an image input device becomes like "[A] longtime exposure" of drawing 
12 (b), and "[B] short-time exposure/' 

[0004] In an adder 1 1 , the pixel value of Images A and B is added and the value shown in 
drawing 12 (b) as a "[C] addition signal^' is memorized by the frame memory 12. The 
configuration of this "[C] addition signal" is determined by the exposure ratio of the image of 
two sheets. In the linear transform section 1 3. the amount I of incident light is presumed from 
the addition signal value S, and it changes into the luminance-signal value Y from the signal 
value of R. B, and G each color in the matrix circuit 15. 

[0005] And in the brightness compression zone 1 6, a brightness value is compressed and 
compressed luminance-signal value Y' is outputted so that the amount of presumed incident 
light may be settled in the fixed number of gradation. R, G, and B which YVY is calculated in 
a divider 1 7 and are the output of the linear transform section 16 — it is multiplied with each 
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signal and multiplier 1 8. and a result is stored in a frame memory 19. 

[0006] Since this image processing technique uses two or more image data, compared with 
the case where tone curve processing of the short-time exposure image is only carried out, 
color reproduction is good and can obtain an image with few noises. 

[0007] Moreover, the image processing technique which creates the image which has depth 
of field deeper than the depth of field of the input optical system mentioned above is realized 
with the configuration shown in drawing 13 . First, weighting addition is carried out with an 
adder 21. and the image which changed the focal location and was photoed is memorized by 
the frame memory 22. If weighting addition of the image into which the focal location was 
changed is carried out according to a focal location, it is known that dotage of the whole 
image will be equalized. 

[0008] So, in the recovery filter setting-out circuit 25. the recovery filter of the dotage in the 
image after addition is determined, and it outputs to the matrix arithmetic circuit 23. Here, 
since it is not a part in connection with the essence of this invention, the creation approach 
of a dotage recovery filter is omitted. In the matrix arithmetic circuit 23, a recovery filter is 
made to act on an addition image, and a result is stored in a frame memory 24. Consequently, 
the image stored in the frame memory 24 is an image with depth of field deeper than image 
pick-up optical system. 
[0009] 

[Problem(s) to be Solved by the Invention] Once the image processing technique mentioned 
above adds or added [ weighting ] the photoed image for every pixel, it was what performs 
dynamic range compression processing and a series of processings of recovery. Therefore, 
when the image set as the object of addition had caused the location gap to each other, it 
shifted, when it added and an exact result was not obtained. 

[0010] Therefore, since destructive read was possible for the case of dynamic range 
amplification processing, while photoing the image by two or more exposure theoretically, as 
the firm stage used and called the need the device using the CMD (Charge Modurated 
Device) component which does not cause a location gap by depth of field amplification 
processing, expensive business-use equipment was needed. Moreover, when changing and 
photoing a focal location, change of the delicate scale factor for every focal location also 
influences. 

[001 1] With a digital camera which a general user uses, the scanner, and the tripod, what [ a 
thing ] that cannot expect precision simple occupies most to it compared with commercial 
equipment. Therefore, the advantage of an image processing technique mentioned above was 
not fully able to be employed efficiently. 

[0012] For example, when a camera moves when carrying and photoing a digital camera to a 
tripod and pushing a shutter, or capturing the image photoed with the film-based camera by 
the film scanner, it is shifting mutually by the method of insertion of a film etc. 
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[001 3] Then, this invention detects the physical relationship between two or more images 
with which photography conditions, such as exposure and a focal location, differ, and aims at 
offering the image processing system amended with the value of the parameter which shows 
the detected physical relationship so that an image may lap with accuracy. 
[0014] 

[Means for Solving the Problem] In the image processing system which performs alignment 
processing between two or more images which photoed the almost same composition 
(photography field) on different photography conditions in order that this invention might 
attain the above-mentioned object A seek-area setting-out means to divide at least one 
image of the inputted image into two or more division fields, and to prepare the seek area of 
the focus showing the description of an image in said each division field. The 1st positional 
information extract means which the characteristic positional information of the photographic 
subject within said composition is related to the coordinate over each division field of said 
division image, and extracts it from the seek area of each of said focus based on the 
characteristic quantity of said image, with the 2nd positional information extract means 
extracted as positional information which said input images other than said divided image 
were alike, respectively, and it received [ positional information ], searched [ positional 
information ] for the point corresponding to said characteristic positional information, and 
related the acquired point of corresponding to the coordinate over the image An amendment 
parameter appearance means to detect the amendment parameter based on the gap between 
each coordinate of said extracted characteristic positional information and the positional 
information of said point of corresponding, Based on the detected amendment parameter, an 
image processing system equipped with an image amendment means to amend an image so 
that the photographic subject location of each image may be in agreement is offered. 
[0015] One in two or more inputted images is chosen, this image is divided into two or more 
fields, and the image processing system of the above configurations sets up the focus from 
the characteristic quantity of that division field, and memorizes the coordinate location of 
that focus, based on the coordinate of the focus , it search for the point of correspond , to 
each another input image which be chose , the coordinate location of the corresponding 
points be extract , the physical relationship between images ( the amount of parallel 
displacements , angle of rotation ) be compute from the coordinate and corresponding points 
coordinate of the focus , and after perform alignment amendment so that the image of one 
side or both may be amend and a photographic subject may agree , dynamic range 
compression processing , depth of field amplification processing , etc. be perform . 
[0016] 

[Embodiment of the Invention] Hereafter, the operation gestalt of this invention is explained 
to a detail with reference to a drawing. The example of a configuration of the image 
processing system as 1 st operation gestalt by this invention is shown in drawing 1 , and it 
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explains to it. 

[001 7] In this operation gestalt, the image which is photoed with the image and film-based 
camera which were photoed with the digital camera which is not illustrated, and was 
photographed with the scanner etc. is recorded on storages, such as a hard disk, a portable 
floppy disk, and a memory card. 

[0018] The image data playback section 31 which will read the image currently recorded on 
said hard disk and floppy disk, the memory card. etc.. and will process expanding etc. if this 
operation gestalt is divided roughly. The image amendment section 30 which performs a 
interpolation operation and amends the physical relationship of the photographic subject of 
an image by the approach of mentioning later from the image data playback section 31 to an 
input image, It consists of the image composition sections 39 which perform dynamic range 
amplification mentioned aboye and depth of field amplification to the image with which 
physical relationship was amended by said image amendment section 30. 
[0019] Moreover, the frame memory 32 said image amendment section 30 remembers 
temporarily the image data to which expanding processing was performed in the image data 
playback section 31 to be. The focus setting-out section 33 which sets up two or more focus 
(coordinate) later mentioned to one selected image, The corresponding^points retrieval 
section 35 which searches for the point of corresponding in another image from the image 
data of the focus circumference started as the focus location memory 34 which memorizes 
the focus coordinate, and a focus coordinate and a template. The corresponding-points 
location memory 36 which memorizes the obtained corresponding-points coordinate location, 
and the amendment parameter calculation section 37 which computes the physical 
relationship between the images of two sheets (the amount of parallel displacements, angle of 
rotation) from a focus coordinate and a corresponding-points coordinate. It consists of 
interpolation operation part 38 which amends the image of one side or both and is outputted 
to the image composition section 39 from the inputted physical relationship. 
[0020] Thus, in the image-processing approach of this constituted operation gestalt, 
processing of expanding etc. is performed in the image data playback section 31, and the 
image by which reading appearance was carried out from said hard disk, memory card, etc. is 
memorized by the frame memory 32 of the image amendment section 30. Here, the data 
outputted from the image data playback section 31 shall contain not only the pixel value of an 
image but additional data, such as image size, the color number, and a color map. 
[0021] Next, one in an input image is chosen (here, it considers as Image A), and it is inputted 
into the focus setting^out section 33. In this focus setting-out section 33, two or more focus 
(coordinate) by the approach of mentioning later is set up, and a focus coordinate is inputted 
into the focus location memory 34. The set-up focus coordinate is inputted also into the 
corresponding-points retrieval section 35. and simultaneously, the image data of the focus 
circumference is started as a template, and is inputted into the corresponding-points 
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retrieval section 35. 

[0022] It is among an image other than the image inputted into the focus setting-out section 
33 (here the image B), and the corresponding-points retrieval section 35 is searched for the 
point corresponding to the inputted template. The approach of searching for corresponding 
points is mentioned later. 

[0023] Consequently, a corresponding-points coordinate location is outputted to the 
corresponding-points location memory 36. In the amendment parameter calculation section 
37, the focus coordinate of the focus location memory 34 and the corresponding-points 
coordinate of the corresponding-points location memory 36 are read, and the physical 
relationship between the images of two sheets (the amount of parallel displacements, angle of 
rotation) is computed. And in the interpolation operation part 38. from the inputted physical 
relationship, the image of one side or both is amended and it outputs to the image 
composition section 39. 

[0024] Although the dynamic range amplification processing and depth of field amplification 
processing which were mentioned above are performed in this image composition section 39, 
since the target image is an image with which location ^^^^^^ was performed in the image 
amendment section 30 of the preceding paragraph, the image naturally put on accuracy is 
obtained as a result image. 

[0025] The configuration of said focus setting-out section 33 is shown in drawing 2 , and it 
explains to it. In this focus setting-out section 33. although two or more focus locations are 
determined, when many focus concentrates on some images, the error of location ****** 
may become large in the other part. So, in the field division section 41, in order to make it the 
focus suitably scattered in an image, an image is divided into two or more fields, and a focus 
seek area is further set as the interior. Here, the example which divided the whole uniformly is 
shown in drawing 3 (a). 

[0026] The small region which serves as a candidate of a template all over this field is moved, 
and the location where characteristic quantity serves as max is outputted as one of the 
focus. However, since the processing time will start dramatically if it searches for the whole, 
it is desirable to set up a focus seek area smaller than the field divided like drawing 3 (a). The 
magnitude of this focus seek area is beforehand decided on the basis of image size like for 
example, 5% of image size. Or it does not matter on the basis of the magnitude of the divided 
small region. 

[0027] Next, in the template fixing section 42, the template candidate location in a focus seek 
area is determined, and the image data in a template candidate is started in the template 
extract section 43 based on the location. At this time, a tempjate candidate's location is 
moved in order within the description seek area in the template fixing section 42. 
[0028] Since a characteristic quantity change of a template candidate near in location may 
not be not much large, in such a case, it is not that of ****** the whole pixel, it can also shift 
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a template candidate's location at intervals of several pixels, and can reduce computational 
complexity as a result. 

[0029] In the characteristic quantity calculation section 44. a template candidate's 
characteristic quantity is calculated and the template location where characteristic quantity 
serves as max in the characteristic quantity judging section 45 is determined. In the template 
extract section 46, the data around a location with which characteristic quantity became max 
are extracted as a template. As for this template extract section 46, the template extract 
section 43 may serve as that role. As this characteristic quantity, pixel value distribution as 
shown, for example in (1) type can be used. 
[0030] 
[Equation 1] 

T = Shi - A I <1) 
i 

Here, ai is a pixel value, A is the pixel value average in a template candidate, and the sum Is 
taken to the whole inside of a template candidate. Moreover, although a concrete formula 
does not mention, they are the secondary pixel value distribution and a value also with an 
edge detection result desirable as characteristic quantity. At this time, said value T is a 
degree type and [0031]. 
[Equation 2] 

** — like, when smaller than a certain default value Tth, it does not adopt noting that it is 
unreliable. For example, although the precision of matching which a pixel value change 
generally mentions later in a small part falls like the part of the empty in drawing 3 (b). by the 
approach of this invention, the focus is not set to a focus candidate location with a value T 
like (2) types, but precision lowering of a physical relationship parameter can be prevented. 
[0032] Drawing 4 is drawing explaining the configuration of the corresponding-points retrieval 
section 35. In the search area setting-out section 51, the location and magnitude of a field 
which search for corresponding points are set up on the basis of the focus coordinate read 
from the focus setting-out section 33. In the correlation operation part 52, the image data of 
the perimeter of a corresponding-points candidate location is started from the image data in 
frame memory 32b so that it may have the same magnitude as the template inputted from the 
focus setting-out section 33 based on the information in the search area set up in the search 
area setting-out section 51, and a correlation value with the template data inputted from the 
focus setting^out section 33 is calculated. 

[0033] In the correlation value judging section 53, the template and the location where 
correlation is the highest extracted in the template extract section 46 are judged, and it 
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outputs to the corresponding-points location memory 36 by making a result into a 
corresponding-points location. 

[0034] Although a corresponding-points candidate generally moves for every pixel at this 
time and a correlation value is calculated, in order to detect a corresponding-points location 
in the precision below a pixel, with reference to a surrounding correlation value, interpolation 
may determine a corresponding-points location. As the correlation value, the absolute value 
sum of the difference shown in the following (3) types, the cross-correlation shown in (4) 
types, the normalization cross-correlation shown in (5) types can be used. 
[0035] 
[Equation 3] 

Here, bi and B are the pixel values and averages in the small region where it moves in the 
search area of Image B, and are sigmaA and sigmaB. It is the standard deviation of template 
data and is sigmaA2 and sigmaB2. It becomes the variance. 

[0036] If it calculates only about a certain representation color when calculating the 
aforementioned (2) • (4) type, it can process at a high speed. Moreover, if the correlation value of 
G, and B each color is added and it searches for corresponding points, it will become possible 
to carry out a response inspection funiculus to high degree of accuracy more. 
[0037] And in the amendment parameter calculation section 37, the physical relationship 
between Images A and B is determined from focus coordinate data and corresponding-points 
coordinate data. The parameters for which it asks are costheta of (6) types, sintheta, and sx, sy 
and M. 
[0038] 

[Equation 4] 

Here, (x, y) show X, a focus location and (Y) show a corresponding-points location, and M is 
equivalent to the relative scale factor between images. Since two or more data are stored in said 
focus location memory 34 and the corresponding-points location memory 36, if it asks for a 
parameter in least square, it will become like (7) types. 
[0039] 

[Equation 5] 

Here, N is the number of the focus. (8) From a formula, M, costheta, and sintheta are 

determined like (9) types. 

[0040] 

[Equations] 
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[0041] moreover, original costheta, sintheta, and cos2 theta+sin2 the case where it was referred 
to as M= 1.0 and becomes relation like (lO) types by the result of (9) types when it can be 
assumed that there is np scale-factor change in an object image, since there is relation of theta= 
1 (ll) types - like " It is better to amend costheta and sintheta. sx and sy were amended. It 
calculates from costheta and sintheta. 
[0042] 

[Equation 7] 

[0043] Although (6) • (9) type mentioned above made the zero of arbitration the center of 
rotation of an image, you may think that the center of gravity of setting out, and each focus and 
corresponding-points location which were searched is in agreement. The center-of- gravity 
location of the focus (it is here (/x, /y) and / is used as a notation meaning an average.) in 
addition, as it is in the image information of each type, in each type, this average is e^qpressed 
as an exaggerated bar - the center-of-gravity location of corresponding points (/X and /Y) it 
is come out and given costheta, sintheta, and sx and sy are given by (12) and (13) formulas, 
respectively. 
[0044] 

[Equations] 

[0045] As explained above, a general user can also do the maximum utiHzation of the 
effectiveness of dynamic range amplification processing and depth of field amplification 
processing, without using an expensive business-use equipment, in order for this operation 
gestalt to extract two or more focus out of an image and to perform location ****** 
automatically. However, when- distortion aberration has arisen in the object image of 
processing, it is necessary to amend beforehand by the technique of arbitration. 
[0046] Next, the 2nd operation gestalt by this invention is explained. As compared with the 1st 
operation gestalt which mentioned this operation gestalt above, the configurations inside the 
focus setting-out section 33 differ. 

[0047] Drawing 5 (a) is drawing showing the notional configuration of the focus setting-out 
section 33. It differs in that the block-definition section 81 is added compared with the 
configuration which showed this configuration to drawing 1 . Drawing 5 (b) is drawing showing 
the example of a configuration of the block-definition section 81. In this block-definition section 
81, two or more fields to observe are directed in the field directions section 83 to the inputted 
image data. The focus is set as the interior of the field specified here by the above-mentioned 
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approach. 

[0048] In this display and control section 84, the specified field (data fironfi the region memory 
85 mentioned later) is overlaid on input image data, as shown in drawing 6 (a) and (b), and that 
data is displayed on a display 82. The display of attachment in PC is su£&cient as this display 
82, and it may prepare the thing of dedication independently. Moreover, the field directions 
section 83 may be directed with the mouse of attachment in PC, and may be prepared 
independently. Although said display and control section 84 was explained as a part of 
configuration of the block- definition section 81, the configuration that the fiinction of operating 
systems (OS), such as a personal computer, is used is suiBficient as it. 

[0049] Furthermore, in the field directions section 83, an attention field may be specified with 
the coordinate in an image. And the region memory section 85 memorizes the location and size 
of the field directed in the field directions section 83, and outputs it to the field division section 
41. In the field division section 41, the focus is set up based on the region information firom the 
region memory section 85 by the approach described above inside the directed field. 
[0050] Since focus retrieval is not needed in the part which is not not much required while 
raising the alignment precision of the part which a user wants to observe and making things by 
the configuration of this operation gestalt, computation time can be shortened. 
[0051] Moreover, although an error will produce them in the alignment of the whole image if 
human being, a vehicle, etc. use the image of the part which moved for count when the 
photographic subject which moves is included in a photography image, it can avoid using the 
data of such a part with the configuration of this example gestalt. 

[0052] Furthermore, it is possible to direct a specific field among two or more fields directed in 
the field directions section 83, and only for the interior to improve the alignment precision of 
the specific region further by setting up many focus firom other fields. 

[0053] Moreover, in the case of a dynamic range amplification technique, compared with the 
case where an image is chosen and performed at random, precision can be improved by 
performing the above-mentioned actuation in order of exposure value between the images 
which in the case of a depth of field amplification technique aUgn and adjoin each other in an 
image in order of a focal location. 

[0054] Drawing 7 is drawing showing the 3rd operation gestalt of this invention. In addition to 
the configuration of the image amendment section 30 which showed the configuration of the 
image amendment section 30 shown in drawing 7 to drawing 1 , a display 82, a display and 
control section 84, and the focus directions section 90 are contained. Two or more focus 
locations are set up by the above-mentioned approach, and are memorized by the focus memory 
34. 

[0055] The focus coordinate memorized by this focus memory 34 is sent to the focus directions 
section 90, and that location is overlaid by the display 82 on an object image through a display 
and control section 84 (for example, drawing 3 (b)). 
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If the focus is set up on the photographic subject (migration body) with which human being, a 
vehicle, etc. move at this time, it will become the cause of the error of the correction factor 
calculated by (6) - (10) formula. So, in the focus directions section 90, when the migration body 
is contained, the body is detected, and the focus set up on the migration body is excepted from 
the data used for count, and deletes data from the focus memory 34. 

[0056] A user judges the displayed data and this actuation may be made to ** the data excepted 
from the focus directions section 90. Moreover, the data of the focus memory 34 and the 
corresponding-points memory 36 are simultaneously displayed on a display 82 after 
corresponding-points retrieval, and when a user judges that the response cannot be taken, you 
may make to except the data into the business which can be directed by the focus directions 
section 90. 

[0057] Next, with reference to drawing 8 , the 4th operation gestalt by this invention is 
explained. This 4th operation gestalt is changed into a configuration as shows the 
block-definition section 81 of drawing 5 to drawing 8 . 

[0058] The block-definition section 81 shown in drawing 8 consists of the field directions section 
83, region memory 85, and the condition judging section 101. With this operation gestalt, the 
range specified as a focus setting-out field based on the statistical and physical property of an 
image is determined. 

[0059] First, the whole image is divided into the magnitude which was able to be beforehand 
decided like drawing 9 (a). Let size divided at this time be the larger range than the template 
started in the focus setting-out section. 

[0060] It judges whether each divided part is sent to the condition judging section 101, and is 
specified as a focus setting-out field. In the condition judging section 101, the inputted image 
data is scanned, and when the saturated pixel is over the fixed rate, it is judged that it is not 
suitable as a focus setting-out field. 

[0061] Moreover, in the condition judging section 101, when it is over the threshold with the 
average of input data, you may judge that it is not suitable as a focus setting-out field. The field 
directions section 83 outputs the image data of the divided field to the condition judging section 
101 in order like drawing 9 (b), and when it is judged that it is suitable as a focus setting-out 
field, it records including the range on the region memory 85. 

[0062] In the explanation mentioned above, although judged for every division field, you may 
make it the whole range currently recorded on the region memory 85 as image data outputted 
to the condition judging section. Moreover, a division field with a user is specified and you may 
make it contain to the focus appointed field in an order from the field of the circumference of it 
in the field directions section 83, as shown in drawing 9 (c). 

[0063] Furthermore, one with a user is specified in the field directions section 83, and the 
rectangle extended to the surroundings of it is assumed and you may make it judge the image 
data in the condition judging section 101, as shown in drawing 10 . 
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[0064] Moreover, although the saturated pixel value was used for the decision criterion, in the 
condition judging section 101, orthogonal transformation, such as discrete Fourier transform of 
the inputted image and a discrete cosine transform, may he judged by the power of the high 
frequency component when giving an image, and the component of wavelet transform. 
[0065] Furthermore, in the condition judging section 101, the contrast of the inputted data, and 
pixel value max and the minimum difference may be used for decision. Next, with reference to 
drawing 11 , the 5th operation gestalt by this invention is explained. 

[0066] This operation gestalt is an example from which the image of three or more sheets is a 
processing object. Here, the same reference mark is given to a configuration part equivalent to 
drawing 1 mentioned above while illustrating, and the explanation is omitted to it. 
[0067] In this operation gestalt, the image data reproduced in the image data playback section 
31 is inputted into one of the frame memories 32a and 32b by the image change section 111 
which carries out change-over actuation with directions of the image selection directions 
section 114. This image selection directions section 114 chooses the processing time of 
equipment etc. at its own discretion so that two or more images with which the inputted same 
photographic subject was photoed can be processed sequentially, and it controls the image 
change-over section 111 to be inputted by turns to two frame memories. 

[0068] The focus and corresponding points are detected by the approach mentioned above from 
the image stored in said frame mernories 32a and 32b, and the physical relationship between 
images (the amount of parallel displacements, angle of rotation, and relative magnification) is 
computed in the amendment parameter calculation section 37. The parameter computed in the 
amendment parameter calculation section 37 is memorized by the amendment parameter 
storage section 113 with Image ID and the reference image ID. 

[0069] Said amendment parameter converter 112 reads the data memorized by the amendment 
parameter storage section 113, and changes them into the amount of parallel displacements 
and angle of rotation which saw each data from the image used as the criteria of the 
amendment specified beforehand. Then, in the interpolation operation part 38, the amendment 
parameter converter 112 amends an image according to the parameter seen from the 
correction-reference image. 

[0070] Amendment by data conversion and the interpolation operation part 38 in the 
amendment parameter converter 112 may be performed for every actuation of the image 
change section 111, and after computing physical relationship relative about all object images, 
an image may be anew read into a frame memory 32 here. 

[0071] Moreover, although this operation gestalt explained that a frame memory 32 was set to 
two and an input image was changed by the signal change section 111, a number of frame 
memories which can store all object images may be prepared. 

[0072] Although the above operation gestalt was explained, the following invention is also 
included in this description. 
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(1) Divide an image into two or more division fields in two or more images with which 
photography conditions differ. Each division field and the same or small focus seek area are 
prepared all over said division field. Based on the statistic of an image, the characteristic 
positional information of a photographic subject is extracted firom each focus seek area. It 
searches for the point of corresponding in a different image fi:om the image which extracted the 
characteristic positional information of a photographic subject among said two or more images. 
The image processing system which detects amendment parameters (the revolution, migration, 
scale*factor change, etc. between images), and amends an image based on the revolution, 
migration, and scale-factor change between the images as said amendment parameter fi^om 
said characteristic positional information and the corresponding positional information of a 
point. 

[0073] This invention corresponds to the 1st operation gestalt. Thereby, in case two or more 
images are piled up, it can carry out by a more exact image making it pile each other up. 

(2) It is characterized by amending in an image processing system given in the aforementioned 
(l) term, after changing a parameter so that the revolution, migration, and scale-factor change 
seen firom the specific criteria image may be expressed in case an image is amended based on 
said revolution, migration, and scale -factor change. 

[0074] This invention corresponds to the 5th operation gestalt. Thereby, in case two or more 
images are piled up, the amendment parameter of suitable arbitration can be set up to each 
image, and superposition of a more exact image according to an intention of a photography 
person can be performed. 

(3) An image processing system given in 1 characterized by restricting the field to divide to 
some images about said two or more division fields. 

[0075] This invention corresponds to the 2nd operation gestalt. In case two or more images are 
piled up, while the rate of an image processing improves by this, a suitable field can be set up to 
each image and superposition of a more exact image according to an intention of a photography 
person can be performed. 

(4) It is characterized by not using for detection of the revolution, migration, and scale-factor 
change between images the positional information set up on the photographic subject which the 
location is moving among two or more images among the characteristic positional information 
of the photographic subject based on the statistic of said image in an image processing system 
given in the aforementioned (l) term or (3) terms. 

[0076] This invention corresponds to the 3rd operation gestalt. Since the field where a 
migration body exists is eliminated by this in case two or more images are piled up, 
superposition of a more exact image can be performed. 

(5) The Umit field which restricts the field divided in an image processing system given in the 
aforementioned (3) term to some images is comparatively characterized by the thing of the 
pixel with which the high firequency component when carrying out orthogonal transformation 
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was saturated comparatively restricted on the basis of the value of the difference of the average 
of a pixel value, and the greatest and minimum pixel value, and either of the contrast. 
[0077] This invention corresponds to the 4th operation gestalt. In case two or more images are 
piled up, while the rate of an image processing improves by this, a suitable field can be 
automatically set up to each image, and superposition of a more exact image according to an 
intention of a photography person can be performed. 

(6) In an image processing system given in the aforementioned (5) term, it is characterized by 
extending a limit field focusing on a specifying point. 

[0078] This invention corresponds to the 4th operation gestalt. Since a suitable field is set up to 
each image focusing on a specifying point by this in case two or more images are pUed up, 
superposition of a more exact image can be performed. 
[0079] 

[Effect of the Invention] As explained in fiill detail above, according to this invention, the 
physical relationship between two or more images with which photography conditions, such as 
exposure and a focal location, differ can be detected, and the image processing system amended 
so that an image may lap with accuracy can be offered with the value of the parameter which 
shows the detected physical relationship. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the example of a configuration of the image processing 
system as 1 st operation gestalt. 

[Drawing 2] It is drawing showing the example of a configuration of the focus setting-out 
section shown in drawing 1 . 

[Drawing 3] Drawing in which drawing 3 (a) shows the focus seek area set as two or more 
division fields where it divided, and each division field in the image, and drawing 3 (b) are 
drawings for explaining the focus. 

[Drawing 4] It is drawing showing the example of a configuration of the corresponding^points 
retrieval section shown in drawing 1 . 

[Drawing 5] Drawing in which drawing 5 (a) shows the example of a configuration of the image 
processing system as 2nd operation gestalt, and drawing 5 (b) are drawings showing the 
example of a configuration of the block-definition section. 

[Drawing 6] Drawing showing an example of the appointed field where drawing 6 (a) was 
displayed on the image, and drawing 6 (b) are drawings showing the attention location 
displayed on the image. 

[Drawing 7] It is drawing showing the example of a configuration of the image processing 
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system as 3rd operation gestalt. 

[Drawing 8] It is drawing showing the example of a configuration of the block-definition 
section used for the image processing system as the 4th operation gestalt. 
[Drawing 9] Drawing for drawing and drawing 9 (b) which show the input image with which 
drawing 9 (a) was divided into two or more division fields to explain assignment of the focus 
setting-out field by scan, and drawing 9 (c) are drawings for explaining assignment of the 
focus setting-out field by escape. 

[Drawing 10] It is drawing for explaining specifying the rectangle extended from the specifying 
point as a focus setting-out field. 

[Drawing 1 1] It is drawing showing the example of a configuration of the image processing 
system as the 5th operation gestalt. 

[Drawing 12] It is drawing showing the example of a configuration for creating the 
conventional extensive dynamic range image. 

[Drawing 1 3] It is drawing showing the example of a configuration for creating the image 
which has the conventional deep depth of field. 
[Description of Notations] 

30 — Image amendment section 

31 — Image data playback section 

32 — Frame memory 

33 — Focus setting-out section 

34 — Focus location memory 

35 — Corresponding-points retrieval section 

36 — Corresponding-points location memory 

37 — Amendment parameter calculation section 

38 — Interpolation operation part 

39 — Image composition section 



[Translation done.] 
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